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flow under an epipolar geometry constraint... 
International Patent Class (Main) : G06K-009/00 . . . 
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Optical flow estimation method for video processing, updating confidence 
t map data determined from primary frame data blocks of encoded image data, 

based on smooth motion field data blocks derived from secondary frame 

data blocks 
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Abstract (Basic) : 

... 2) computer readable recording medium for storing optical 

flow estimation program. . . 

...The figure shows the pictorial representation of image sequence of 
MPEG-2 encoded video data stream. . . 
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Movable subject image quality optimizing method for microscope, involves 
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fields, and applying operation to image data along trajectory 
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Abstract (Basic) : 

... a) an arrangement for optimizing the image quality of image 

sequences of movable subjects acquired with a microscope. . . 

. . .b) a software causes a microscope system to carryout a method of 
optimizing the image quality of image sequences of movable 
subjects acquired with a microscope... 

. . .Used for optimizing the image quality of image sequence of movable 
subject acquired with a microscope... 

...The drawing shows a block diagram of a method of optimizing the image 
quality of image sequences of movable subjects acquired with a 
microscope ... 

. . . Optical flow calculator (53 
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Optical flow computing method used in image processing method, 
determines optical flow by enforcing optical flow consistency constraint 

Abstract (Basic) : 

An INDEPENDENT CLAIM is also included for apparatus for 
computing optical flow . 

...Used in optical flow image processing method for detecting salient 
motion in image sequence or for super resolution image 
reconstruction 
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Image motion vector field generation apparatus for processing video data, 

calculates optical flow from image frames input to frame memories, 
using specific interactive formulae 

Abstract (Basic) : 

... The frame memories (612,614) receive image frames (602^604) 

respectively. A calculator (600) calculates optical flow from 
the image frames using specific iterative formulae for X and Y image 
velocity estimates... 

. . . processing and applications, such as motion compensation coding 

of digital television (TV) , noise reduction for video sequences , 
frame rate conversion and target tracking, for the recovery of 
three-dimensional motion and structure... 

... optical flow calculator (600 
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. . . which detects optical flow segments indicative of loci of moving 
objects moved in a moving picture sequence 

Abstract (Basic) : 

filtered optical flow segments indicative of loci of moving 
objects apparently moved in the moving picture sequence in the time 
interval. The filtered optical flow segments generated are added 
to the previous optical flow segments detected to generate 
integrated optical flow segments indicative of loci of moving 
objects . 

12/3, K/.6 (Item 6 from file: 350) 

DIALOG (R) File 350: Derwent WPIX 
(c) 2005 Thomson Derwent. All rts. reserv. 

015123844 **Image available** 

WPI Acc No: 2003-184367/200318 

XRPX Acc No: N03-145185 

Motion estimation in image processing apparatus provided with motion 
estimation unit to calculate optical flow in sequence of video 
images 
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Motion estimation in image processing apparatus provided with motion 
estimation unit to calculate optical flow in sequence of video 
images 



12/3, K/7 (Item 7 from file: 350) 

DIALOG (R) File 350:Derwent WPIX 

(c) 2005 Thomson Derwent. All rts . reserv. 



014540801 **Image available** 

WPI Acc No: 2002-361504/200239 

XRPX Acc No: N02-282547 
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feature points and estimated spatio-temporal rates using least mean 
square estimation 
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Abstract (Basic) : 



image of the face, estimating spatio-temporal rates of change in 
intensity at them using images from the sequence , estimating 
translation and rotation of the face and coding them. 

Method is for coding the movement of a head from a sequence of 
images . 



.Method is more accurate and less computationally 
optical flow and affine motion model 



burdensome than the 
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Abstract (Basic) : 

The method employs a SPAMM pulse sequence as the pulse 



sequence 



and uses angle images to compute directly and automatically planar 
strain in 2 dimensions or a full strain tensor. . . 

The angle images may also be employed to compute displacement, 
synthesize tag patterns and compute optical flow without 
requiring the use of regularization . . . 
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Target change between first and second images indicating system - has 
second device coupled to first device for receiving electrical signal 
transmitted by first device and third device coupled to second device for 
digitising electrical signals 
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. . .Abstract (Basic) : The system includes a first device for sensing a 
sequence of images of the target including the first image, the 
second image and an additional image previous in the sequence to 
the first image and the second image. A second device is coupled to 
the first device for receiving. . . 

...for determining a first processed image in response to assigning a 
respective weight to each image previous in the sequence to the 
second image . A fifth device is coupled to the fourth device for 
indicating a change in the... 

...automatically detecting motion of target moving either along ground or 
through air. Increased accuracy of optical flow computation is 
less sensitive to noise in image data, while indicating change between 
images in which. . . 
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Object images epipolar geometry estimating method for e.g. stereo 
vision processing application, involves transforming points of two images 
into projective space, and performing nonlinear optimization on 
fundamental matrix 
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Object images epipolar geometry estimating method for e.g. stereo 
vision processing application, involves transforming points of two images 



Abstract (Basic) : 

. . . Used for estimating epipolar geometry between multiple 

images of an object for stereo vision processing application and 
computer vision application. . . 

...The drawing shows an overview block diagram of an epipolar geometry 

estimating method. . . 
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Autonomous vehicle e.g. mobile robot, has computation unit to compute 
epipolar geometry information based on orientation information and 
corresponding points between images, and analysis unit to analyze 3D 
information of object 
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Autonomous vehicle e.g. mobile robot, has computation unit to compute 
epipolar geometry information based on orientation information and 
corresponding points between images, and analysis unit to analyze... 

Abstract (Basic) : 

... 141) to detect corresponding points from two consecutive images 

obtained through a camera (110). An epipolar computation unit (142) 
computes epipolar geometry information based on orientation 
information and information on the points. A 3D analysis unit (144... 

. . . The autonomous vehicle correctly obtains epipolar geometry 

information from the two corresponding points, thereby simply and 
accurately analyzing the motion of the. . . 

...International Patent Class (Main): G06K-009/00 
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Three-dimensional object multi -resolution modeling method involves 
reconstructing object from combination data that is produced by defining 
epipolar geometrical representations of images with matrix 
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. . . multi -resolution modeling method involves reconstructing object from 

combination data that is produced by defining epipolar geometrical 

representations of images with matrix 

Abstract (Basic) : 

... are obtained as two-dimensional images, and are digitally 

combined. A combination data defined by epipolar geometrical 
representations of the images with a matrix, is produced, and the 
object is reconstructed from. . . 
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Optical flow computing system for video system, has image processor that 
derives epipolar geometry for images from point matches included 
between images and computes optical flow for each pixel of images 
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Optical flow computing system for video system, has image processor that 
derives epipolar geometry for images from point matches included 
between images and computes optical flow for each pixel . . . 

Abstract (Basic) : 

... The system has an image processor (104), which derives epipolar 

geometry for the images from point matches that are included between 
the images. The processor computes... 

...of the images under a constraint that are derived from a fundamental 
matrix for the epipolar geometry . 

The epipolar geometry constraint provides improved accuracy 
and performance in computing optical flow. . . 

...block diagram of a video system employing a method of computing optical 

flow under an epipolar geometry constraint... 
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Abstract: Image matching is an important process in computer vision, and 
it can be used in computing optical flow , stereo matching, object 
tracking and so forth . We present a method of feature point matching 
between sequences of images using a relaxation labelling algorithm 
with efficient candidate selection. The initial features are selected among 

... time, we propose two modified methods. These methods have been 
implemented and tested with various image sequences . The matching 
results show the effectiveness of our method. 
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Title: A correlation-relaxation-labeling framework for computing 
optical flow -template matching from a new perspective 

. . .Abstract: the gradient-based approach in dealing with such 
applications. The two fundamental uncertainties in feature matching , 
whether template matching or feature point correspondences, are 
discussed. Correlation template matching procedures are established based 
on likelihood measurement. A method for determining optical flow is 



developed. . . 
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. . . fundamentals and robust algorithms for the problem of estimating 
three-dimensional motion and structure from image sequences under 
either perspective or orthographic projection. A theoretical framework and 
a system of methods are. . . 

...and edges are quantized for further use such as matching. 

Robust algorithms for obtaining unambiguous matches of point 
features and edges are developed, which enforce intensity or contour 
consistency, and geometric, rigidity, disparity. . . 

...can be admitted in occluded regions. 

Uniqueness conditions for determining structure and motion from 
monocular image sequences under either perspective or orthographic 
projections are established. Robust algorithms for estimating structure and 
motion . . . 

...discontinuity boundaries and occluded regions without using surface 
models . 

Physics-based vision problems such as optical flow and shape from 
shading are also addressed . New concepts and methods such as generalized, 
3D, constrained, and parametric optical flows are introduced. . . 
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...Abstract: an enormous challenge according to a recent survey. Most 
current systems are based on a calculation of the optical flow 
between the current and previous frames to adjust the label position. Here 
we present two alternative algorithms based on geometrical image 
constraints. The first is based on epipolar geometry and provides a 
general description of the constraints on image flow between two static 
scenes .'. . . 

...Descriptors: image sequences ; 
...Identifiers: epipolar geometry ; 



15/3, K/2 (Item 2 from file: 2) 

DIALOG (R) File 2: INSPEC 

(c) 2005 Institution of Electrical Engineers. All rts. reserv. 

08510563 INSPEC Abstract Number: C2003-02-6130V-061 
Title: Visual registration for geographical labeling in wearable computing 

Author (s): Ke Xu; Cheok, A.D.; Kar Wee Chia; Prince, S.J.D. 
Author Affiliation: Nat. Univ. of Singapore, Singapore 

Conference Title: Proceedings Sixth International Symposium on Wearable 
Computers (ISWC 2002) p. 109-16 

Publisher: IEEE, Piscataway, NJ, USA 

Publication Date: 2002 Country of Publication: USA xv+240 pp. 
ISBN: 0 7695 1816 8 Material Identity Number: XX-2002-03147 

U.S. Copyright Clearance Center Code: 0-7 695-1816-8/02/$17 . 00 
Conference Title: Proceedings Sixth International Symposium on Wearable 
Computers (ISWC 2002) 

Conference Sponsor: IEEE Comput. Soc. Tech. Committee on Wearable Comput 
Conference Date: 7-10 Oct. '2002 Conference Location: Seattle, WA, USA 
Language: English 
Subfile: C 
Copyright 2003, IEE 

...Abstract: of geographical landmarks is a simple wearable computing 
application. Most current systems are based on calculation of optical 

flow between the current and previous frames to adjust the label 
position. Here we present two alternative algorithms based on geometrical 
image constraints The first is based on epipolar geometry and provides 
a general description of the constraints on image flow between two static 
scenes . . . 
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Title: An integrated neural and algorithmic system for optical flow 
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...Abstract: motion areas in the scene; a matching algorithm is then used 
to obtain a sparse optical flow and to compute the epipolar 

geometry of the moving camera; and, finally, a refinement algorithm is 
used to produce a denser... 
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...separate rigidly moving objects in the field of view. 
This transformation usually begins with the computation of optical 
flow : the motion of the brightness pattern on the imaging array. The 
first part of this... 

...of the scene into rigidly moving objects. 

Once the separate regions have been identified, the epipolar 
geometry for the motion of each can be computed. The epipolar geometry 



is expressed in terms of the Fundamental Matrix which contains the motion 
information for each. . . 

...based on a Kalman filter is presented, along with experiments on both 
synthetic and real image sequences . 

Finally, the approach taken in the dissertation is reviewed and 
recommendations for improving performance are... 
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Title: Computation of optical flow by five-point-constraint 

least-squares method 

Abstract: The algorithm first calculates intersections of the optical 
flow constraint line of the central pixel with constraint lines of its 
eight-connected pixels. From... 

. . . in the middle position and close to each other. These four points 
correspond to four optical flow velocities of middle values. The four 
chosen points and the central pixel compose five-credible-points and their 

. . . constraint equations compose a super determinant equation group. The 
least-squares method is used to calculate the optical flow velocity 
of the central pixel. Such an approach results in higher computing 
efficiency and robustness. 

Descriptors: image sequences ; 



18/3, K/2 (Item 2 from file: 2) 

DIALOG (R) File 2 : INSPEC 

(c) 2005 Institution of Electrical Engineers. All rts. reserv. 

08914315 INSPEC Abstract Number: B2004-05-6135E-12 9 , C2004-05-1250M-088 

Title: Optical flow estimation and segmentation through surface fitting 
and robust statistics 

Author(s): Hongshi Yan; Tjahjadi, T. 

Author Affiliation: Sen. of Eng., Warwick Univ., UK 

Conference Title: SMC ' 03 Conference Proceedings. 2003 IEEE International 
Conference on Systems, Man and Cybernetics. Conference Theme - System 
Security and Assurance (Cat. No . 03CH37483 ) Part vol.2 p. 1390-5 vol.2 

Publisher: IEEE, Piscataway, NJ, USA 

Publication Date: 2003 Country of Publication: USA 5 

vol. (lxiv+lii+5045) pp. 

ISBN: 0 7803 7952 7 Material Identity Number: XX-2003-0324 6 

U.S. Copyright Clearance Center Code: 0 7803 7952 7/2003/$17 . 00 
Conference Title: SMC '03 Conference Proceedings. 2003 IEEE International 

Conference on Systems, Man and Cybernetics 

Conference Sponsor: Syst., Man & Cybernetics Soc. IEEE 

Conference Date: 5-8 Oct. 2003 Conference Location: Washington, DC, 



USA 

Language: English 
Subfile: B C 
Copyright 2004 , I EE 

...Abstract: to smooth an image, and least-median-of-squares (LMedS) 
robust regression is used to calculate the optical flow , which can 
tolerate up to 50% outlier contamination. Second, the estimated optical 

flow map is segmented through a mean shift technique. Third, an affine 
flow model is employed to fit the coarse flow estimates... 

... regions, and the affine fitted motion of the regions is refined with a 
robust least median squares process based on optical flow 
constraints. The experimental results have demonstrated that our approach 
achieved good performance in most synthetic and real video sequences . 

...Descriptors: image sequences ; 

...Identifiers: video sequences 



18/3, K/3 (Item 3 from file: 2) 

DIALOG (R) File 2 : INSPEC 

(c) 2005 Institution of Electrical Engineers. All rts . reserv. 

07854066 INSPEC Abstract Number: A2001-07-8760I-016, B2001-04-7510N-027 , 
C2001-04-7330-149 

Title: On the use of optical flow methods with spin-tagging magnetic 
resonance imaging 

Author (s): Moser, K.W. ; Georgiadis, J.G.; Buckius, R.O. 

Author Affiliation: Lab. for Quantitative Visualization in Energetics, 
Illinois Univ., Urbana, IL, USA 

Journal: Annals of Biomedical Engineering vol.29, no.l p. 9-17 
Publisher: Biomed. Eng. Soc, 

Publication Date: Jan. 2001 Country of Publication: USA 

CODEN: ABMECF ISSN: 0090-6964 

SICI : 0090-6964 (200101 ) 2 9 : 1L . 9 : OFMW; 1-S 

Material Identity Number: A293-2001-002 

U.S. Copyright Clearance Center Code: 0090-6964/2001$15 . 00 
Language : English 
Subfile: ABC 
Copyright 2001, IEE 

...Abstract: the robustness of the optical flow algorithm to noise and 
indicate that a 7%-10% average error can be expected from the optical 

flow calculations alone, independent of MRI image artifacts. 

Experiments on spin-tagging MRI images for a Re... 
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...Abstract: measurements are used. To have available enough information, 
most existing techniques are based on the intermediate computation of 
. optical flow which, however, poses a problem at the locations of depth 
discontinuities. If we knew where... 

. . . the estimation are then utilized to perform .a reconstruction of the 
scene from a short sequence of images . The technique- is based on 
constraints on image derivatives which involve the 3D motion and. . . 

. . . their relationship to the minimization of the epipolar constraint, and 
present experimental results using real image sequences that indicate 
the robustness of the method. 
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...Abstract: multiresolution version of the technique is also presented, 
again based on LMedS regression, which enables Image sequences 
containing large motions to be effectively handled. An extensive set of 
quantitative comparisons with a... 

... natural scenes with known flow) and natural images. Both angular and 
absolute flow errors are calculated for those sequences with known 
optical flow . Displaced frame difference error, used extensively in 

video compression, is used for those natural scenes... 
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. . . estimator) . The motion constraint equation and the 2-D affine motion 
model are used to compute the optical flow in a local neighbourhood. 
The use of the least- median -squares robust estimator enables points where 
optical flow cannot be computed to be rejected as outliers rather 

than assigning erroneous flow to such points. In addition... 

. . . neighbourhood strategy eliminates the block-effects that are commonly 
faced in local differential methods for computing optical flow . The 
algorithm is also able to deal with cases of the local neighbourhood 
straddling regions of three motions. Results for both synthetic and real 
image sequences are presented. 
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computed to measure its inter-view global motion. . . 
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ISBN: 0 7803 2766 7 Material Identity Number: XX95-01817 
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Conference Title: Proceedings 1995 Canadian Conference on Electrical and 
Computer Engineering 

Conference Sponsor: IEEE Canada 

Conference Date: 5-8 Sept. 1995 Conference Location: Montreal, Que., 
Canada 

Language: English 
Subfile: ABC- 
Copyright 1996, IEE 

...Abstract: procedure for the detection, quantification and correction 
of translational motion during tomographic acquisition. The method 
computes the optical flow vector field between two successive views. 
The optical flow vector field assigns to each pixel of a tomographic 

view a two dimensional velocity that describes its motion across the image 
plane between two successive views. The average optical flow of a 
region of interest is when computed to measure its interview global motion. 
Motion . . . 

• ...Descriptors: image sequences ; 

...Identifiers: average optical flow ; 
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Author Affiliation: Dept. of Syst. & Inf., Florence Univ., Italy 
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Publication Date: April 1994 Country of Publication: Netherlands 
CODEN: PRLEDG ISSN: 0167-8655 

U.S. Copyright Clearance Center Code: 0167-8655/94/$ 07 . 00 
Language: English 
Subfile: B C 

...Abstract: is suggested, in which relaxation is accomplished by a mesh 
grid of loosely coupled simple computational units, one for .each image 
point where optical flow has to be computed . Optical flow smoothing 
is performed by a vector median filter, whose nonlinear nature is helpful 
in preserving motion boundaries. Results on both synthetic and... 

...Descriptors: image sequences ; 
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U.S. Copyright Clearance Center Code: 0031-3203/ 93/$6 . 00+ . 00 
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Subfile: B C B C 

Abstract: There are two different approaches for estimation of structure 
and/or motion of objects from image sequences in the computer vision 
community. One is the optical flow approach, and the other is the 

feature correspondence approach. Direct methods have been developed, that 
use the optical flow approach, but avoid computing the full optical 

flow field as an intermediate step for recovering structure and motion. 
The unified optical flow field (UOFF) theory has also... 

. . . structure is recovered from a given pair of stereo images instead of 
from a monocular image sequence . 

...Descriptors: image sequences ; 
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Author Affiliation: Dipartimento di Fisica, Genova Univ., Italy 
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and Information Systems. Proceedings of the IFIP TC 7 Conference p. 

349-55 
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Title: 3D motion and structure from image sequences 
...Abstract: can be computed by assuming that the spatial gradient of the 
time-varying brightness of image sequences is stationary. The obtained 
dense vector * field, or optical flow, which estimates ' the spatial 
displacement. . . 

... is also demonstrated. Qualitative information on the viewed motion can 
also be obtained by segmenting optical flow in the regions where the 
average percentage of uniform expansion, pure rotation, and shear is 
larger than a given value. This... 

. . . Due to the very good agreement between expected and experimental 
results, it is concluded that optical flow can efficiently be use din 
many computer vision applications. 
...Identifiers: image sequences ; 
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...Abstract: to smooth an image, and leas t-median-of-squares (LMedS) 
robust regression is used to calculate the optical flow , which can 
tolerate up to 50% outlier contamination. Second, the estimated .optical 
flow map is segmented through a mean shift technique. Third, an affine 
flow model is employed to fit the coarse flow estimates... 
...regions, and the affine fitted motion of the regions is refined with a 
robust least median squares process based on optical flow 
constraints. The experimental results have demonstrated that our approach 
achieved good performance in most synthetic and real video sequences . 
17 Refs. 
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Abstract: This paper deals with a new method for estimation of motion 
field in image sequence coding domain. The proposed method is based on 
a pel-recursive technique- and characterised by. . . 

Identifiers: Motion estimation; Markov random fields; Pel recursive 
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algorithms; Bayesian estimation; Displaced frame difference; Mean squared 
error 
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Abstract: Optical flow has been used for matching or tracking of 
individual image objects through a time sequence of images and is 
applied to the problem of image interpolation by treating the serial slice 
images as a spatial sequence . Calculation of optical flow between 
two images results in a 'velocity vector map 1 indicating the relative 
displacement between similar... 

...slices i minus 1 and i plus 1 and then comparing i 1 with the original 
middle scanned slice, i. Optical flow interpolation compares favorably 



to linear interpolation both visually and quantitatively. Quantitative 
comparison, vertical bar i... 
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, 2004, V3212, 2, P372-380 

ISSN: 0302-9743 Publication date: 20040000 

Publisher: SPRINGER- VERLAG BERLIN, HEIDELBERGER PLATZ 3, D-14197 BERLIN, 
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Language: English Document Type: ARTICLE (ABSTRACT AVAILABLE) 

Abstract: Optical flow algorithms generally demand for high 

computational power and huge storage capacities. This paper is a 
contribution for real-time implementation of an optical flow 
algorithm on a pipeline machine. This overall optical flow 
computation methodology is presented and evaluated on a set of 
synthetic and real image sequences . Results are compared to other 
implementations using as measures the average angular error, the 
optical flow density and the root mean square error. The proposed 
implementation achieves very low computation delays, allowing operation 
at standard video. . . 

18/3, K/16 (Item 2 from file: 34) 

DIALOG (R) File 34 : SciSearch ( R) Cited Ref Sci 
(c) 2005 Inst for Sci Info. All rts. reserv. 

02515892 Genuine Article#: LG673 No. References: 23 

Title: MULTIWINDOW LEAST- SQUARES APPROACH TO THE ESTIMATION OF OPTICAL-FLOW 
WITH DISCONTINUITIES 

Author (s): BARTOLINI F; CAPPELLINI V; COLOMBO C; MECOCCI A 

Corporate Source: UNIV FLORENCE, D I PART I MENTO I NGN ELETTRON , VIA S MARTA 
3/1-50139 FLORENCE/ /ITALY/ ; UNIV PERFEZIONAMENTO S ANNA, SCU OLA 
SUPER, ADV ROBOT TECHNOL & SYST LAB/l-56127 PISA/ /ITALY/ ; UNIV 
PAVIA, DIPARTIMENTO ELETTRON/ 1-27100 PAVIA/ /ITALY/ 

Journal: OPTICAL ENGINEERING, 1993, V32, N6 (JUN), P1250-1256 

ISSN: 0091-3286 

Language: ENGLISH Document Type: ARTICLE (Abstract Available) 

Abstract: The use of optical flow fields in image sequence analysis 
allows us to perform motion-based segmentation as well as 3-D 
reconstruction. Many. . . 

...Other techniques compute the flow field based only on local information. 
A local algorithm explicitly addressing the problem of evaluating a 



reliable optical flow field at motion boundaries is presented. 
Velocity vectors are computed as solutions of a multiwindow. . . 
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...a camera navigating along an unknown trajectory through an unknown 
stationary environment. Given the time sequence of images obtained by 
the camera, the task is to simultaneously estimate both the camera's 
trajectory. . . 

...in time using additional image frames. The approach is successfully 
demonstrated on natural and synthetic image sequences . 

The image sequences have a wide field of view--it is shown that a 
wide field of view. . . 

...desired result as output. No feature detector needs to be built. No 
correspondences need be computed . Estimating optical flow is not an 
intermediate step. (3) No restrictions are placed on the camera motion or 
the environment's depth... 
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DOCUMENT TYPE: Journal 
ARTICLE TYPE: Original paper 
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Efficient Estimation of Highly Accurate Optical Flow by Pixel-Wise 

Matching and Vector Median Filtering. 
ABSTRACT: There , is the gradient method for optical flow estimation to 

detect moving objects from image .sequences in computer vision. We 



propose a method of optical flow estimation using pixel-wise 
matching and vector median filtering. Estimated flows by our method 
have sufficient accuracy in motion edge. Our method consists of two 
steps. First, we calculate optical flow constraint equation and 
estimate optical flow vector using the pixel-wise matching 
procedure, which is based on the equation at each pixel. Second, a 
vector median filtering procedure is applied to the optical flow 
field, which is specifically aimed to remove estimation errors and to 
preserve motion boundaries. The... 
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Title: Fundamental matrix from optical flow : optimal computation 
and reliability evaluation 

...Abstract: a special equation analogous to the epipolar constraint 
arising in stereo vision. Computing the "flow fundamental matrix " of 
this equation is an essential prerequisite to undertaking three-dimensional 
analysis of the flow. . . 
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Abstract: This paper addresses robust feature tracking. The aim is to track 
point features in a sequence of images and to identify unreliable 
features resulting from occlusions, perspective distortions and strong 
intensity changes. We... 

...show a quantitative example of the benefits introduced by the algorithm 
for the case of fundamental matrix estimation. The complete code of 
the robust tracker is available via ftp. 
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.SPECIFICATION displacement information signal 208a which is obtained 
from between the images taken in by the image sensor 204 respectively 
at the time points t4 and t5 is output from the image displacement 
detection . . . 

.of the fact that the value of the image displacement information signal 
208a of the image displacement detecting circuit 208 which is 
dispersively obtained timewise through the operation described in the 
foregoing involves a time delay, . . .of example the image plane of a 
currently photographed field. Fig. 21(b) shows an optical flow 
obtained by accumulating for a given period of time a difference 
between the current field and an immediately preceding ... employed by the 
image shake quantity detecting circuit 340 is not limited to the 
representing point matching method. The movement can be detected at a 
high speed by image processing. The method. . . 
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Detailed Description 

Detailed Description 

... images i, j, k are related by the following. 
Hikco = HjkcoHuco . (4) 

As noted above, point matches between any image v pair within the 
image 

sequence 200 are known or may be readily computed (e.g., by sparse 
optical flow computation ) , and therefore epipoles and f tindarnental 
matrices may be easily determined. 

Furthermore, at least one infinity. . . 
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English Abstract 

Point matches between images within an image sequence are 
identified by sparse optical flow computation and employed to 
compute a fundamental matrix for the epipolar geometry, which in turn "is 
employed to derive an epipolar geometry constraint for computing dense 
optical flow for the image sequence . The epipolar geometry constraint 
may further be combined with local, heuristic constraints or robust 
statistical . . . 

Detailed Description 

... to provide, for use in video system, a method of computing optical 
flow for an image sequence by imposing a global, non-heuristic, 
geometrical constraint. Point matches between inia, es within the 
image sequence are identified by sparse 
. 9 

optical flow computation and employed to compute a fatidamental 
matrix for the epipolar geometry, which in turn is employed to derive an 
epipolar geometry constraint for computing dense optical flow for the 
image sequence . The epipolar geometry constraint may further be 
combined with local, heuristic constraints or robust statistical... 
pixels, between images within the sequence. 

In the present invention, optical flow for the received sequence of 
images 200 is computed by first performing the sparse optical flow 

computation described above. That is, the points in the image (s) with 
the richest information, content (e.g., high variation in I, 1,, such as 
comers) are identified and matched between images within the sequence 
. The identified point matches are then employed to compute the 
epipolar geometry relating the views between consecutive frames, 
described by a fundamental matrix F. Normally at least seven point 
matches are required to compute the fundamental matrix F relating all 
pixels within two images for the image sequence . 

In computing the fundamental matrix, a pinhole camera model illustrated 
in Fig. 5D is employed ... to one embodiment of the present invention. The 
process 400 begins with receipt of an image sequence (step 401) for 
which optical flow information is needed. Point matches between 
images within the image sequence are first computed utilizing 
sparse optical flow computation (step 402), and are employed to 
determine the fundamental matrix of correlation between images within 
the image sequence (step 403) . 
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Claims 

Detailed Description 

According to a third aspect of the present invention there is provided 
computer readable recording medium on which is recorded an optical 
flow estimation program for causing a computer to execute the 
following steps- extracting, from encoded image data representative of 
an image sequence of a changing object having a motion field, first 
ftaine data blocks not incorporating motion. . . 

Claim 

... of Claims 12 to 2 1, incorporating a digital processor. 

23 A computer readable recording medium on which is recorded an 
optical flow estimation program for causing a computer to execute 
the following steps: (a) extracting, from encoded image data 
representative of an image sequence of a changing object having a 
motion field, first frame data blocks not incorporating motion. . . 
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Detailed Description 

English Abstract 

A method and apparatus for determining the optical flow of a 
sequence of image frames . Optical flow fields are computed in 

manner that enforces both brightness constancy and a consistency 
constraint . 

Detailed Description 

. . . sub-pixel motion can be determined using the foregoing methods . To 
demonstrate the improvement of optical flow computations , the 
foregoing optical flow methods have been applied to a 
super-resolution method using semi-synthetic data where flow. . . 

. . .The present invention is also applicable to flowbased super-resolution 
optical flow processes. For example, video • sequences captured with 
digital video camcorders. 

[0054] It should be noted that when the present invention computes 
consistent flow field. . . 
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Detailed Description 

... and background training. Motion segmentation is used to find regions 
in each frame of an image sequence that correspond to moving objects. 
Motion segmentation starts from a motion field obtained from optical 
flow calculated on two consecutive frames. The motion field is divided 
into two clusters using k-means . . . 
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Method and System for the Estimation and Compensation of 
Brightness Changes for Optical Flow Calculations 
Background of the Invention 
Field of the Invention 

The present invention is directed generally to... 

...respect to non-motion brightness changes to improve the estimation of 
dense motion fields in sequences of images , such as, e.g. video 
images, by optical flow computation . 
KelatedArt 

An example of motion estimation by optical flow computation is set 

forth 

in application Serial No. 09/593,521, filed June 14, 2000, entitled... 

...Max Griessl and Markus Wittkop. This application is hereby incorporated 
by reference. 

Motion estimation by optical flow computation between two 
consecutive images of a sequence is limited by the fact that the 
optical flow constraint does not allow for brightness... 
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... the time period of interest. Motion of the upper eyelid during 

blinking is detected by calculating the vertical optical flow in 
the eye image region and matching it to an expected signal. Optical flow 
is a well-known teclmique used to compute motion in sequence of images 
. Detafis of a suitable optical flow calculation are contained in 
"Determining Optical Flow " , Artificial Intelligence Volume 17, 
pl85-204, 1981 by B Horn et al . The sharp transition... 
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The computation of optical flow 

Beauchemin, S S; Barron, J L 

ACM Computing Surveys v27n3 PP: 433-467 Sep 1995 
ISSN: 0360-0300 JRNL CODE: ACI 

...ABSTRACT: projection of the 3-dimensional motion of objects, relative to 
a visual sensor, onto its image plane. Sequences of time-ordered 
images allow the estimation of projected 2-dimensional image motion as 
either instantaneous image velocities or... . 

. . . to-collision and focus of expansion calculations, motion compensated 
encoding, and stereo disparity measurement. The computation of optical 
flow is investigated. ... 
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Direct proportion of three-dimensional motion from patterns of visual 
motion . 

Fermuller, Cornelia; Aloimonos, Yiannis 
Science, v270, n5244, pl973(4) 
Dec 22, 1995 

ISSN: 0036-8075 LANGUAGE: English RECORD TYPE: Fulltext; Abstract 

WORD COUNT: 3349 LINE COUNT: 00261 

TEXT: 

...input (2). This difficulty is compounded because the information 
that can be derived from the sequence of images sensed by the moving 
retina is not the exact projection of the 3D motion field. . . 

...of light patterns. The exact movement of every point on the image is 
termed the optical flow field. In general, accurate values of the 
optical flow field are not computable ; the so-called normal flow, the 
component perpendicular to the edges, is the only component. . . 
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Objective Quantification of the Motion of Soft Tissues in the Orbit. 

Abramoff, Michael D.; Niessen, Wiro J.; Viergever, Max A. 
IEEE Transactions on Medical Imaging, 19, 10, 986 
Oct, 2000 

ISSN: 0278-0062 LANGUAGE: English RECORD TYPE: Abstract 

...AUTHOR ABSTRACT: coded by hue and magnitude by saturation of the pixel. 
Current clinical circumstances limit MR image acquisition to short 
sequences and short acquisition times. The effect of these limitations on 



the performance of optical flow computation has been studied for four 
representative optical flow algorithms: on short (nine frames) and long 
(21 frames) simulated sequences of rotation of a magnetic resonance (MR) 
imaged object, on short measured MR sequences of controlled rotation of 
the same object and on short MR sequences of motion in... 
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Three-Dimensional Trajectory Estimation from Image Position and Velocity. 

BLOSTEIN, STEVEN D. ; ZHAO, LIN; CHANN, ROBERT M. 

IEEE Transactions on Aerospace and Electronic Systems, 36, 4, 1075 
Oct, 2000 

ISSN: 0018-9251 LANGUAGE: English RECORD TYPE: Abstract 

. . .AUTHOR ABSTRACT: for estimating the three-dimensional trajectory and 
structure of a moving rigid object in an image sequence has been 
previously developed by Broida, Chandrashekhar , and Chellappa (1). Since 
then, steady advances have occurred in the calculation of optical flow 
. This work improves 3-D motion trajectory and structure estimation by 
incorporating optical flow into. . . 

...a hybrid feature point/optical flow algorithm, demonstrated through 
detailed simulation on synthetic and real image sequences , 
significantly lowers bias and mean squared error in trajectory estimation 
over the feature-based approach. . . 
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RET I MAC : REal-TIme Motion Analysis Chip. 

Nesi, Paolo; Innocenti, Fabrizio; Pezzati, Paolo 

IEEE Transactions on Circuits and Systems-II: Analog and Digital..., v45, 
n3, p361(15) 
March, 1998 

ISSN: 1057-7130 LANGUAGE: English RECORD TYPE: Abstract 

AUTHOR ABSTRACT: Motion estimation is relevant for applications of both 
motion-compensated image sequence processing and dynamic scene analysis 
of computer vision. Different approaches and solutions have been proposed 



...reliable and precise with respect to several solutions proposed in the 
literature. Index Terms - ASIC, computer .vision, motion estimation, 
optical flow estimation, real-time implementation. 
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Three-dimensional surface reconstruction using optical flow for medical 
imaging . 

Weng, Nan; Yang, Yee-Hong; Piers on, Roger 

IEEE Transactions on Medical Imaging, vl6, n5, p630(12) 

Oct, 1997 

ISSN: 0278-0062 LANGUAGE: English RECORD TYPE: Abstract 

AUTHOR ABSTRACT: The recovery of a three-dimensional (3-D) model from a 
sequence of two-dimensional (2-D) images is very useful in medical 
image analysis . Image sequences obtained from the relative motion 
between the object and the camera or the scanner contain. . . 

...2-D image. The 3-D motion of an object can be recovered from the 
optical - flow field using additional constraints. By extracting the 
surface information from 3-D motion, it is possible to get an accurate 3-D 
model of the ob j ect . Both synthetic and real image sequences have been 
used to illustrate the feasibility of the proposed method. The experimental 
results suggest... 

. . . for the reconstruction of 3-D models from ultrasound medical images as 
well as other computed tomograms. Index Terms - Motion analysis, optical 
flow , surface reconstruction, ultrasound imaging . 
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Computation of optical flow using basis functions. 

Rakshit, Subrata; Anderson, Charles H. 

IEEE Transactions on Image Processing, v6, n9, pl246(9) 
Sep, 1997 

ISSN: 1057-7149 LANGUAGE: English RECORD TYPE: Abstract 

ABSTRACT: Computation methods to estimate optical flow in image 

sequences are described. Modifications to Horn's algorithm illustrates the 
impact image representation has on accuracy and computation. Images which 
have been resampled at twice the Nyquist rate reduces computation cost in 

optical flow estimations. Good results are achieved using a 
multiresolution basis function and information encoding. 
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Tistarelli, Massimo 
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pl243 (8) 
Dec, 1996 

ISSN: 0162-8828 LANGUAGE: English RECORD TYPE: Abstract 

AUTHOR ABSTRACT: The computation of the optical ■ flow field from an 
image sequence requires the definition of constraints on the temporal 



change of image features. In this paper. 



...velocity field. Moreover, by hypothesizing a constant acceleration 
motion model, also the derivatives of the optical flow are lcomputed . 
Several experiments are presented from real image sequences . Index 
Terms - Optical flow, velocity field, differential constraints, dynamic 
vision, motion analysis, image velocity, dynamic. . . 
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Evaluation of differential optical flow techniques on synthesized echo 
images . 
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IEEE Transactions on Biomedical Engineering, v43, n3, p259(14) 
March, 1996 

ISSN: 0018-9294 LANGUAGE: English RECORD TYPE: Abstract 

AUTHOR ABSTRACT: The performance of three methods for evaluation of motion 
on synthesized 2-D echo image sequences with features similar to real 
ones are examined. The selected techniques based on the computation of 
optical flow are of the differential type and assume that the image 
brightness pattern is constant over. . . 
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Recognizing human facial expressions from long image sequences using 
optical flow. 

Yacoob, Yaser; Davis, Larry S. 

IEEE Transactions on Pattern Analysis and' Machine Intelligence, vl8, n6, 

p636(7) 

June, 1996 

ISSN: 0162-8828 LANGUAGE: English RECORD TYPE: Abstract 

...AUTHOR ABSTRACT: approach to the analysis and representation of facial 
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ABSTRACT: An efficient multiscale algorithm is used to compute a 
solution for the dense optical flow field problem in an image 
sequence used in regularization methods for image processing. The 
noniterative algorithm has a per pixel computational complexity that does 
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sequences results in considerable computational savings. 
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to be divergence free. 
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ABSTRACT: This paper describes procedures for obtaining a reliable and 
dense optical flow from image sequences taken by a television (TV) 
camera mounted on a car moving in usual outdoor scenarios. The optical 
flow can be computed from these image sequences by using several 
techniques . 

14/3, K/18 (Item 2 from file: 484) 

DIALOG (R) File 484 : Periodical Abs Plustext 
(c) 2005 ProQuest. All rts. reserv. 

02685160 (USE FORMAT 7 OR 9 FOR FULLTEXT) 

Direct perception of three-dimensional motion from patterns of visual 
motion 

Fermuller, Cornelia; Aloimonos , Yiannis 
Science (GSCI), v270 n5244, pl973-1976 
Dec 22, 1995 

ISSN: 0036-8075 JOURNAL CODE: GSCI 

DOCUMENT TYPE: Feature 

LANGUAGE: English RECORD TYPE: Fulltext; Abstract 

WORD COUNT: 3157 LENGTH: Long (31+ col inches) 

TEXT: 

input (2) . 

This difficulty is compounded because the information that can be 
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the exact projection of the 3D motion field. . . 
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velocity field. A simple algorithm that computes an optical flow 
from sequences of real images is presented. 
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